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Abstract: Reinforcement learning is bedeviled by the curse of 
dimensionality: the number of parameters to be learned grows exponentially with the size of any compact 
encoding of a state. Recent attempts to combat the curse of dimensionality have turned to principled ways of 
exploiting temporal abstraction, where decisions are not required at each step, but rather invoke the execution of 
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